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A Hodel For Evaluating Tlie Sources Of Professional Esteem 
For Vocational Teacher Education Programs 



Quality , . yuu know what It Is, yet you don* t know 
what it Is, But that * s self contradictory. But some 
things are better than others, that is, they have more 
quality. But when you try to say what the quality is, 
apart from the things. that have it, it all goes poof! 
There's nothing to talk about. But if you can't, say 
what Quality ISj how do you know what It is, or how do 
you know that it even exists? If no one knows what It 
Is^ then for all practical purposes It doesn' t 
exist at all , But f _qr all practical purposes It 
really does exist. What else are grades based on? 
Why else would people pay fortunes f or soiob things and 
throw others In the trash pile? Obviously some things 
are better than others , , , but what's the 
"betterness"? , , , So round and round you go, 
spinning mental wheels and nowhere finding anyplace 
to get traction. What the hell is Quality? What Is 
it? 

Sobert M, Plrslg 
Zen and the Art of 

Hotorcvcle Maintenance 

Excellence, like quality, is a difficult construct^ not 

only to measure but also to attain. Striving for academic 

excellence, however. Is a worthy goal for colleges and 

universities, as well as for divisions and departinents within 

those institutions, Giearly, the same is true of teacher 

education prog:rams in vocational education across the 

country. In a study that determined 68 critical issues 

facing vocational teacher education, <Zeiinar & Parrish, 

1986> seven out of the top 10 were directly related to the 

'•quality aspects'* of vocational teacher education. 

Respondents to the survey implemented by the teacher 

education and staff development committee of the American 

Vocational Association cited such terms as recruitmeni , 

image, attractiveness of the profession, and technological 
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enhancement as iaajor points of influence that need to be 

addressed In the association's fTatiaro activities. However, 

unlike other disciplines in education, vocational teacher 

education, has not designed nor implemented a model , 

Instrument or strategy for evaluating its professional 

quality or esteem <:Satterwhlte , 1983). Vocational service 

areas have not been without guidance In determining their 

program enq^hasls. TLe various service areas have established 

standards and criteria for evaluation. This was mainly due 

to the enactment of the Vocational Act of 1963 which 

allocated funds specifically for program evaluations of state 

and local programs to assess their relevance and cuallty 

<Sat terwhlte, 1983> . The evaluation aspects of the 1963 Act 

parallel In many respects, much of the current movement for 

teacher education reform. 

Finn <1981>, In his stirring article, "Toward a New 

Consensus," stressed i:hat the unifying idea for a national 

consensus on education must be that of quality. Among 10 

precepts Finn <1981> proposed for the establishment of a new 

consensus, teacher education is most important. 

. . . because the indispensable ingredient of 
eduoational excellence is high-quality instruction by 
talented and well-trained teachers, the highest 
priority of American education in the years ahead must 
be the recruitment , selection, preparation^ and 
retention of outstanding instructionial personnel at 
every_ level from kindergarten through graduate school. 
The declining quality of those entering and staying in 
teaching poses the gravest long-term threat to the 
quality of the educational enterprise. <p. 62) 

4 

the Holmes 6roup <1986) reaffirmed the importance of 
attracting high-quality students to undergo a more rigorous 
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preparation and training for the eventual establlshinent in a 
career In teaching, at secondary, post secondary , or cciiege 
level . 

The recruitment of these hlgh-quallty studentis Into the 
profession Is an Important consideration If vocational 
teacher education Is to prosper In an upcoming time of 
speculation and evaluation. According to Zellner and Parrlsh 
<1986^, of the 68 Identified Issues noted by vocational 
educators, "Recruiting highly competent and committed 
persons*' <p. 39> was Identified as the most critical issue 
facing vocational teacher education. As prospective teachers 
are considering whether to ma^or In a vocational discipline, 
what criteria can they consider when selecting an Instittatlon 
%o attend? The answer^ In at least one study was academic 
quality <Krukowskl, 1985>. Students are more eager to pay 
for and attend a college with the reputation or programs they 
believe will lead to high paying jobs and top professional 
schools. However, the school's perceived prestige, rather 
than soine other measure of Its academic quality, may be what 
attracts students to the Institution. Selection of an 
Institution to attend Is sometimes based on studies which 
rank or Identify outstanding colleges or programs located 
within universities. This is one of a number of methcDds 
Webster (1981) Identifies for assessing program quality. 

Perhaps the best known effort in establishing a 
reputatlonal study was the one conducted by Alan Cartter 
<1966) . His research on graduate prograins was based an 
ratings from 4,000 scholars from more than 100 universities. 
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the assumptic5n made by tiie study was, the higher the degree 
of agreement among experts, the greater the possibility their 
opinion is accurate. Frohreich and Sims <1973) coudiicted a 
study to rank departments of educational administration. They 
identified criteria that were important for judging programs, 
e»g»» quality of st^adents, eminence of faculty, support 
services, and size of faculty. Margulles and Blau <1973) 
conducted a reputatlbnal study which resulted in the ranking 
of 17 types of professional programs. As respondents^ the 
deans of the professional schools were asked to Identify the 
five most outstanding schools In their own profession. 
Studies such as the ones previously mentioned are noticeably 
absent from the profession of vocational teacher ed'acation. 
Moore's C1982) analysis of the scholarly productivity of 
agricultural education teacher educators and Satterwhlte* s 
<1983> ranking of marketing teacher education programs are 
the only studies known to the authors which recognize 
professional esteem as a contribution to the literature base 
In vocational education. 

Purpose of the Study 
The purpose of this study wais to ^*ccompllsh the 
fol lowing obj ect 1 ves : 

1. To develop a model for evaluating the esteem hald 
for vocational teacher education prograias by members of the 
profession. 

2. To test the model by: 

A. identifying the top iO agricultural teacher 
education programs in the United States and 
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B. determining what criteria agricultural teacher 
educators 'use In rating the top 10 agricultural teacher 
educat 1 oh pr ogr ains . 

3. To determine the rankings of the programs based upon 
the respondents faculty rank, current American Ass^ociation of 
Teacher Educators In Agriculture CAATEA) region of the 
respondent* and AATEA region of Institution In which 
respondent earned doctorate • 

Procedui^es 

An Instrument entitled "A Survey of Teacher Education 
Perceptions" was developed for the study, based on a review 
of the reputatiohal literature and vallda'ced by a panel of 
teacher educators In both agricultural education and In other 
vocational service areas. It was field tested oh a second, 
similar panel of teacher educators. The final instrument 
consisted of three section;^: a section of demographics Judged 
to be of interest in analyzing the results as specifi*?^d in 
question 3 above; a section asking for the respondent to 
list, in rank order^ the top 10 Institutions, as he or she 
perceives them, and give reasons for the rankings; and a 
section asking similar information regarding Individual 
teacher educators. This paper deals only with the program 
ratings and res. sons. 

The population for the study was defined as all 
agricultural teacher educators^ n=324i listed by Rogers 
<1985. , with names of non-teacher educators ekcluded. Using 
ititerpolaticix in the Warmbrod <1965> procedure for 
determining sample silze^ it was determined that a sample of 
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11=162 would be appropriate. A systematic procedure with a 
random start was used to select the sample for the study. 

in order to avoid biasing the results of the study, a 
system to insure the anonymity of the researchers was 
developed. Neither the mailing address af the Institution 
collecting; the data, nor any r«^ference to its name was made 
oh the outside envelope, cover, letter, or return envelope. 
Dr. Larry D. Case, Education Program Specialist, Agriculture, 
Office of Vocational and Adult Education, United States 
Department of Education, agreed to assist by mailing 
pre-stamped envelopes from his Alexandria, Virginia office, 
and to receive the completed surveys and return them to the 
researchers. He also agreed to write a cover letter 
explaining the heed for anonymity of the researchers and 
assuring participants thax the study was legitimate. In 
order to avoid the appearance that the study was officially 
sanctioned by the Department of Education, the cover letter 
was typed on plain statidiiei-y, with Dr. Case's name but 
without an official title. 

After two follbw-ups, a total of 125 responses were 
received, for a total return rate of 77.2%; however, a small 
number of the surveys returned were npt usable. The usable 
return rate was 69.1% <n=112) . Because of the need for 
anonymity, no telephone fbllbw-up was cbuducted. 

Analysis of Data 
The reasons were analyzed using cbhteixt analysis 
technlq^ues with calculatldns done inahually. The numerical 
data were analyzed using SAS descriptive statistics 



A Kodel Far • 

7 

prdcedures tc5 determine rankings; Ratings of institutions 
were weighted from 0 <not mentioned) to io (rated first), for 
each respondent* 

To determine least significant difference CtSD) between 
mean ratings^ the following procedure was used. First, the 
hypothesis of homogeneity of variance was tested for the mean 
ratings among the top 10 progran^ (Hlyikle, Wlersma* & Jurs, 
1979), see table 2. That was tested using an F-ratlo 
computed using the Hax s-VMin s==, which produced F==2.528, 
which was not significant. Then assuming homogeneity of 
variance i the pooled variances were taken <Hinkle, et, al . 
1979), producing a pooled standard deviation of 3.477. The 
standard error of the means resulting from that operation was 
0.328. Multiplying that figure (Pedhauzer, 1932) by the 
value of t=1.96, where p<:t)<.65, produced a LSD of 0.644. 

Kecsults 

Top Progran^ 

The minimum requirement for Inclusion in the camputatioii 
was for a program to be named among the -cop 10 by at least 
three respondents. The mean ratings for such named 
ihstitutions ranged from .038 to 6.314. Tte mean ratings for 
the first and second ranked institutions C6 696 and 6.277, 
respectively) were clearly and significantly different both 
from each other and from the other members of the top 10; 
however, the third through lOth institutions were grouped 
more closely to each other <;3.536 to 1.672, respectively), 
where the least significant difference was 6.644 <p < .05). 

Table 1 indicates that Ohio State was ranked highest 

9 
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with a xneaii rating df 6.696. Iowa State was ranted second 
witii a mean rating of 5.27. Also making the top 10 pr^bgrams^ 
In order were Virginia Tecli^ Texas A & Pennsylvania State ^ 
Mississippi State, University of Minnesota^ Cornell, Oklahbia 
State, and University of Florida. The latter eight programs 



had a range in mean scores from 3.536 to 1.872. 
TABLE 1 

Overa^H.^ankln^s and Rank Means for Top ±Q Agricultural Teach 



Edubart^ ^^n-Pr ogr ane < h= 1 1 2 ) 


Rani: 


Programs 


Mean 


S. D. 


1 


□hid State University 


6. 6§6 


4. 280 


2 


Iowa State University- 


5.277 


3. 907 


3 


Virginia Tech 


.3.536 


3. 5213 


4 


Texas A & K UhlverBlty 


3.500 


3. 304 


5 


Pennsylvania State University 


2 . 964 


3.561 


6 


Hlsslsslppi State University 


2.955 


3. 473 


7 


University of Minnesota 


2. 714 


3. 405 


8.5 


Cornell Unlversi'«;y 


2. 429 


3. 098 


8. 5 


Otlalibma State University 


2. 429 


3.284 


10 


University of Florida 


i- ??2 


2.692 



Notes: 

a) Based on a scale rah]*: where lst=10^ 2nd=9, . . . unranked^O. 
b> Least Significant Dif f erence-0. 644 <P<.05> given 
hombgeheity bf variance and a pooled S. D. of 
- 3. 477. 



10 



A Model For 
9 

The eleventh through twentieth ranked programs were as 
follows: <11> University of Missouri, <12> UiilveriBlty of 
lillnbis, <13) University of Arizona, <14> Louisiana State 
tJniversity, <i5) University of Nebraska, <16> Purdue 
University, <17> University of California-Davis, <18> 
Michigan State University, <19> eallfornla Polytechnic State 
University-San tuis Obispo, and <20> Colorado State 
University. 
Criteria Used 

Table 2 indicates that faculty was the primary criterion 
used by agricultural teacher educators in ranking peer 
programs. The category research/^publlcatlons and scholarship 
was ranked second with overall program ranked third. 
Graduate programs/'graduates were ranked fourth with 
undergraduate programs ranked fifth. 
TAStS 2 

Ranklnyrs of Criteria Used by Agricultural^r ^cher Educatbr s-^< 
Rank Pe e r Pr og^r ams 



Number of times 
Rank Criteria Used 



1 Faculty 328 

2 Resear ch/Fub 1 i cat i ons/Scho 1 ar shi p 168 

3 Over ail Program 129 

4 Graduate Program/Graduates 97 

5 Undergrad uat e Progr am 9 1 
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Tlie f acuity criterion had several specific cbmmehts 
concerning faculty sucli as **reaclies beyond state*** 
"responsibilities within prof esslbiii *• "high quality faculty^** 
and "prof esslbhal Integrity." Among the single word modifiers 
used to describe faculty were size* hardworklhgi leadershlpi 
creat 1 ve , and courage . 

For the criterion researchXpubllcatldns/schdlarshlp 
several specific descriptions were also uised. Among these 
descriptions were visibility, aniount. national program 
involvement, productivity, and capabilities. 
Faculty Rank 

Differences were found among respofdents* faculty ranks 
and their mean: ratings of agricultural teacher educatidii 
programs. Ohio State and iowa State were ranked first and 
second, respectively by respondents in all three ranks of 
assistant, associate, and full professor. On the other hand, 
Virginia Tech was ranked third, fourth, and fifth, 
respectively by respondents in each rank starting with 
assistant professor. 

Three institutions not named in the top 10 overall are 
also recognized in Table 3. touisiana State University was 
ranked 10th by assistant professors and 14th overall. The 
University of Illinois was ranked 8.5 by full professors and 
12th overall. The University of Missouri was ranked 10th by 
full pibfessbrs and 11th overall. 
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TABLE 3 

Rankings of Agriculi; ural Teach e r Education Prbf^rams by Facu l^^y 
Rank of Respondents 



Faculty rank ^ 



Ove ra 1 1 Ass i st ant Assoc i ate Fu 1 1 

Rank Progran^ P'rofessor Professor Professor 

<n=24) <n=37) <n=46> 



1 


- - 1 - - T» — J— - - - - •1 — 

Ohio State University 


1 


1 


1 


2 


Iowa State University 


2 


2. 


2 


3 


Virginia Tech 




4 


5 


4 


Texas A & M University 


7 


3 


4 


5 


Pennsylvania State Univ. 


6 


6 


8.5 


6 


Mississippi State Univ. 


5 


5 


6 


7 


University of Minnesota 


9 


6 


3 


8. 5 


Corne 1 1 University 


4 


10 


7 


8.5 


bklahoma State Univ. 




7 




io 


University of Florida 


8 


9 




ii 


University of Missouri 






10 


12 


University of Illinois 






8.5 


14 


Louisiana State Univ. 


io 







AATBA Regions 

Table 4 indicates a variation based on respondents* 
AATEA regions <Figure 1. ) in their rankings of agricultural 
teacher education programs. So prograla received the same 
ranking from respondents in all four regions. Ohio State was 
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FlQURE i. THE AMERICAN ASSOCIATION OF TEACHER 
EDUCATORS IN AGRIGULTURE (AATEA) STATES BY REGION 
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ranked first lii tile central ^ easteriii and southern rejglohs 
but third in the western region. Iowa State was ranked first 
by the western region respondents and second by respondents 
in the other three regions. Pennsylvania State j Oklahoma 
State 9 and University of Florida were ranked among the top 10 
by respondents in three of the four regions. 
TABLE 4 

Ranking s of Pr ^rams^ by Gurr^nt— AATEA^ Rej ^lbii of R e spond e nt 
Overall Central Eastern Southern Western 



Rank 


Programs 


<n=36) 

- — 


<n=20> 

- - — - — 


<n=405 


<n=16) 

- 


i 


Ohio State University 


i 


1 


1 


3 


2 


Iowa State University 


2 


2 


2 


1 


3 


Virginia Tech 


3 


4 


3 


6 


4 


Texae A «6 H University 


6 


7 


4 


2 


5 


Pennsylvania State Univ. 


4 


3 


8 




6 


Hlsslsslppl State Univ. 


7 


8 


S 


8 


7 


University of Minnesota 


5 




9 


7 


8. 5 


Cornell University 


8 


5 


7 




8.5 


Oklahbina State Uhlv. 


10 




6 


4 


10 


University of Florida 




6 


10 


10 


11 


University of Hlssdurl 


9 








12 


University of Illinois 




10 






13 


University of Arizona 
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Three programs not in the top 10 are also recognized in 
Table 4. The University of Missouri, ranked 11th overall, 



A if ode i For 
14 

was ranked ninth by respondents in the central region. The 
University of Illinois, ranked 12th overall, was ranked iOth 
by respondents in the eastern area. The University of 
Arizona ranked I3th dverail, but was ranked fifth by 
respondents in the western region. 

Table 5 shows the rankings of prograins by AATEA regions 
of respondents' doctoral degree granting institution. Ohio 
State was ranked first among respondents frdin three regions 
and 3rd in the western region. Iowa State was ranked second 
in the central region, fourth in the eastern and southern 
regions, and fifth in the western region. Pennsylvania State 
and Cornell tied for second in the eaiBterii region* Texas A 8t 
K was ranked second by doctoral degree recipients from the 
southern region. Oklahoioa State and the University of 
Arizona tied for first in the western region. 

There was a large difference in the number of 
respondents obtaining doctoral degrees from the four regions. 
The largest was the central region with 50 respondents. The 
smallest was the western region with five respondents. 

Cone 1 us 1 ons 

The mast iii5>Drtant criterion used for rating programs of 
agricultural teacher education was associated with the people 
in the specific programs. It was concluded that the "people 
factor", represented by the faculty members and their 
associated public accomplishments, such as researoh, 
publications, and scholarship most influenced the peer 
respondents. Another important people factor was represented 
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TABtE 5 

Ranklnprs of Programs by AATEA Refflon of Institutions Granting 
Respondent * s Doctorate 



Central Eastern Southern Western 



Hank 




Programs <n= 

— — 


=50^ 




€n=20) 




€n=235 




- - 


1 


Ohio State University 


1 


i 


i 


3 


2 


I owa State University 


2 


4 


4 


5 


Q 


Virginia Tech 


3 


6 


3 




4 


Texas A & M University 


6 


5 


2 


8 


5 


Pennsylvania State Univ. 


8 


2. 5 


7 




6 


Mississippi State Univ. 


5 


8 


5 


4 


7 


University of Minnesota 


4 


7 


10 




8.5 


Cornell Un 1 ve r s 1 t y 


10 


2. 5 






8. 5 


Oklahoma State Univ. 


7 




6 


1.5 


10 


University of Florida 


9 


lb 


8 




12 


University of Illinois 




9 






13 


University of Arizona 








1.5 


14 


Lotaisiana State University 










19 


Gal Poly, San tuis Obispo 








9 


20 


Colorado State University 








7 


27 


Montana State University 








6 



by the graduate program^ undergraduate program, and 
graduates of the program. it was concluded that factors 
other than people, such as prestige of the institution and 
Impressive canipus facilities did not influence the peer 
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perceptions. 

Peer ratings across faculty rank of respondent were 
quite stable fox the top five progratns, N'dne of these 
prdgrafiis was rated outside the top 10 by any of the three 
respondent categories. Much less stability was shown for the 
programs rated sixth through fourteenth, with notable 
variability in ratings across faculty rank of respondent. 

Peer ratings across AATEA region of respondent was quite 
stable for the top five programs. Only one prog;rain was, rated 
outside the top 10 by respondents in any of the four regions. 
Programs rated sixth through thirteenth were less stable, 
with some being listed in the top 10 by respondents in only 
one region. 

Program rankings were fairly stable across AATEA reg;ion 
of institution granting the respondents* doctorate, but less 
so than on the two previous variables. Two of the top five 
programs were rated outside the top 10 by respondents with 
degrees from one region. Notably^ one region's respondents 
rated three programs among the top 10^ which were not rated 
by any of the other regions* respohdehts. The small number 
of respondents with degrees from the Western region should be 
noted. Clearly, the region from which the respondent 
received the doctoral degree affected the ratings of 
programs. 

Overall , it was concluded that people in programs most 
influenced the prbgralr. rankings. Additional ly* in order to 
be rated ainong the top programs in agricultural education, an 
institution must develop a broad-based approach to secure 
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national visibility of ttxose people in scholarly and 
leadership roles. 

Hecommendat i ons 

All vbcatlbnal service area teacher education programs 
could utilize the pragmatic evaluation model established in 
this study. It should v;ork equally well for an across-the- 
board evaluation of teacher education programB for specific 
service area evaluations. 

Vbcatlbnal teacher education programs seeking greater 
prestige should put their resources into promoting faculty 
visibility among members of the profession. Secondly, 
resources should be used to encourage publications and 
national and regional presentations on the part of faculty 
members. 
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